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ABSTRACT 

We present a high spatial-resolution HST /NICMOS imaging survey in the field of a known proto- 
cluster surrounding the powerful radio galaxy MRCl 138-262 at z = 2.16. Previously, we have shown 
that this field exhibits a substantial surface overdensity of red J — H galaxies. Here we focus on 
the stellar masses and galaxy effective radii in an effort to compare and contrast the properties of 
likely protocluster galaxies with their field counterparts and to look for correlations between galaxy 
structure and (projected) distance relative to the radio galaxy. 

We find a hint that quiescent, cluster galaxies are on average less dense than quiescent field galaxies 
of similar stellar mass and redshift. In fact, we find only two (of nine) quiescent protocluster galaxies 
are of similar density to the majority of the massive, quiescent compact galaxies (SEEDs) found in 
several field surveys. Furthermore, there is some indication that the structural Sersic n parameter is 
higher (n ~ 3 — 4) on average for cluster galaxies compared to the field SEEDs (n 1 — 2) This result 
may imply that the accelerated galaxy evolution expected (and observed) in overdense regions also 
extends to structural evolution presuming that massive galaxies began as dense (low n) SEEDs and 
have already evolved to be more in line with local galaxies of the same stellar mass. 
Subject headings: galaxies: clusters: individual (MRCl 138-262) - galaxies: evolution - galaxies: high- 
redshift - galaxies: structure 



1. INTRODUCTION 

The internal spatial and velocity distribution of stars 
is an indicator of the manner in which galaxies have 
formed, assembled and evolved. In the local universe, 
tidal streams, shells and kinematically distinct cores are 
examples of archeol offlcal clues to past merging and for- 
mation events (e.g., Peng et al. 2002b ; "Emsellem et al.' 
2007[ [van Dokku ni| |2005 ; Blanton & Moustakas 2009). 
Even coarse measures, such as the average stellar surface 
mass density within the effective radius (S50), correlate 
with the star formation rate or the mean stellar age. Gi- 
ant elliptical galaxies have high stellar mass per unit area 
(or volume) and show negligible current star formation 
while more diffuse stellar disks and dwarf irregulars are 
forming stars at sometimes prodigious rates per unit stel- 
lar mass (specific star-formation rate; sSFR). At higher 
redshift, ana l ogous relations are already in place (e.g., 
Franx et al.||20Q8l ). While observationally it remains 
difficult to separate high-redshift galaxies into classical 
Hubble-types we can now photometrically determine red- 
shifts, stellar masses and galaxy sizes f or large numbers 
of galaxies at z ^ 2. Such studies (e.g., IZirm et al.ll2007l 
Toftet al.|2QQ^[^a n Dokkum et al. 2008; Toft et al. 2009; 
Williams et aTpQlO, ,Mosleh et al.|2011^ have found that 
quiescent galaxies are in general more dense than their 
star- forming counterparts. 
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The origin of this bi-modal distribution of galaxy prop- 
erties is unclear. It is possible that the quiescent z ^ 2 
galaxies are more compact because they formed when 
the universe was smaller and more dense and mergers 
were more gas-rich. It also seems plausible that the pro- 
cess which quenches star formation may be linked to a 
morphological change. Or perhaps the dominant forma- 
tion processes differ for galaxies with different present- 



day stellar masses ( Khochfar fc Silk 2006 
Dekel fc BiriA3h^|2008| [Dekel et al.||2000[ ) 
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In general terms, dissipation should result in more 
compact stellar cores th an dissipationles s assembly (e.g., 
Ciotti, Lanzon i, fc Volo nteri 2007; Naa b, Johansson, fc| 
ristriker^ 2009^ jOser et al.^^2010) . Dense stellar systems. 



once tormed, tend to persist through successive (minor) 
mergers. The relatively recent discovery of quiescent 
massive and compact galaxies at 2: ~ 2 (hereafter Semi- 
Evolved Elephantine Dense galaxies or "SEEDs") implies 
that at least some galaxies have t heir oriffln in high- 
redshift (z > 4), gas-rich mergers ( Daddi et al. 2005 



Zirm et al.||2QQ7l [rbfTet al.||2007| [van Dokkum et al 



2008[ [Cimatti et al.||2008p . These mergers resulted in 



many stars being tormed in a relatively small volume. 
By z ^ 2 these systems have low star-formation rates 
and relatively high stellar masses in addition to their 
small sizes (rg ^ Ikpc). The SEEDs therefore have ex- 
treme internal stellar mass densities They do not fall on 
the size-mass relation defined by local galaxies. Their 
evolution from z 2 to z = is therefore a puzzle. 

The most massive galaxies in the present-day universe 
are located at the centers of rich clusters. These galaxy 
overdensities were statistically the first to separate from 
the Hubble flow and collapse and are therefore believed to 
follow an accelerated timeline for the process of galaxy 
formation. There is some observational evidence that 
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galaxies in the progenitors of clusters, protoclusters, do 
have significantly older stars and higher masses than 
galaxies in the field at similar redshifts (Steidel et al. 
2QQ5[ Tanaka et al.|2QlQ ). Might cluster galaxies, having 
formed earlier, be even more dense than field SEEDs? 
Or, alternatively, the 'fast-forward' evolution of cluster 
galaxies may lead to lower density galaxies in protoclus- 
ters compared to their field counterparts. It is interest- 
ing, then, to look for dense SEED galaxies in protoclus- 
ters at redshift z ~ 2. 

We have undertaken a NICMOS imaging program to 
study the red galaxy population in a protocluster at 
z = 2.16. Broad and narrow-band imaging, both in the 
optical and near-infrared, of the field surrounding the 
powerful radio galaxy MRC 1138-262 = 2.16) have 
identified more than 100 candidate companion galaxies. 
There are surface-overdensities of both line-emitting can- 
didates (Lyman-a and Ha), X-ray point sources, sub-mm 
selected galaxies and r e d optical-n e ar-infrared galaxies 
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1^ ilteen of the 
Lya and 9 of the Ha emitters liave been spectroscopi- 
cally co nfirmed to lie at th e same redshift as the radio 
galaxy (Kurk et al. 2004a). By obtaining deep images 
through the INlClVlOs Jno and i^ieo filters, which effec- 
tively span the 4000A-break at z = 2.16, we have identi- 
fied a large surface overdensity of red galaxies consistent 
with a forming red sequence (Zirm et al. 2008). In this 
paper we present a more detailed analysis of the masses 
and morphologies of galaxies in this field. The article is 
organized as follows: in Section §?? we describe the data 
and their reductions, in Section §?? we present the photo- 
metric redshifts, stellar population models and morpho- 
logical fits, in Section §?? we present the internal stellar 
mass densities and other derived properties and finally in 
§?? we discuss these results in the context of galaxy evo- 
lution models. We use a (I^a^^m) = (0.7,0.3), i^o = 73 
km s~^ Mpc~^ cosmology throughout. At z = 2.16 one 
arcsecond is equivalent to 8.4 kpc. All magnitudes are 
referenced to the AB system (^Oke|1974j) unless otherwise 
noted. 

2. OBSERVATIONS AND DATA REDUCTIONS 

2.1. NICMOS Imaging 

The NICMOS instrument on-board HST is capable of 
deep near-infrared imaging over a relatively small field- 
of-view (51'' X 51''). In the case of MRC 1138-262, we 
know that galaxies are overdense on the scale of a few 
arcminutes ( Kurk et al.|2004b Croft et al.|2005 ) and are 
thus well-suited lor observations with INICIVIUIS camera 3 
on HST. We used 30 iJST orbits to image seven overlap- 
ping pointings in both filters and one additional pointing 
in HiQo alone. These observations reach an AB limiting 
magnitude (miocr; lOcr, ^'-^ diameter circular aperture) of 
miocr = 24.9 mag in Jno and miocr = 25.1 mag in i^ieo- 
The same field was imaged in the ^475 (mioo- = 27.5 mag) 
and /814 (miocr = 26.8 mag) filters using the Wide-Field 
Channel of the Advanced Camera for Surveys on HST diS 
part of a Guaranteed Time program (# 10327; Miley et 
al. 2006). 

The NICMOS images were reduced using the on-the-fiy 
reductions from the HST archive, the IRAF task pedsky 
and the dither/drizzle package to combine the images in 



a mosaic. The dither offsets were calculated using im- 
age cross-correlation and were refined iteratively. Align- 
ment of the pointings relative to each other was accom- 
plished using a rebinned version of the ACS Igi^ image 
as a reference. The final mosaic has a pixel scale of O'.'l. 
Galaxies were selected usin g the ij^iBO-band iniage fo r de- 
tection within SExtractor (Bertin & Arnouts 1996). We 



used a 2.2<j detection threshold with a minimum con- 
nected area of 10 pixels. We also corrected the NICMOS 
data for the count-rate dependent non-linearity (de Jong] 
2006). Total galaxy magnitudes were estimated by using 
the MAG_AUTO values from SExtractor. We show the 
outline of the NICMOS mosaic in Figure [T] along with 
the positions of the radio galaxy (yellow star) and star- 
forming (blue circles) and quiescent (red circles) proto- 
cluster galaxies. 

The Jiio — iJi6n colors w ere determined by running 



SExtractor (Bertin & Arnouts 1996) in two-image mode 



using the Hiqq image lor object detection and isopho- 
tal apertures. The Jno image was PSF-matched to the 
ij"i6n band. We a lso incorporated the two ACS bands 
(Miley et al.| |2006D , the Spitzer IRAC bands, Un ( |Zirm] 
et al. 2008rand\/ bands fr om JCeck/LRIS, z anTT^ 
from VLT/F0RS2 ( |Kurk et al.||2004b|a ), H band from 
NTT/SOFI and J and Ks from Subaru/MOIRCS (jK^ 
dama et al. 2007). The assembly of the merged multi- 
band catalog is detailed in Tanaka et al. 2010. 

2.2. FIREWORKS Survey Data and Literature Sample 

The FIREWORKS data are described in detail in 
Wuyts et al. (2008). In brief, the survey is i^s'-band 
selected to 5cr depth of 24.3 (AB) over an area of 1130'. 
In addition to the deep Ks band data there is high- 
quality imaging in each of the [/, 5, /, z, J, the 
four Spitzer/IRAC bands and the 24/im Spitzer/MIPS 
band. The combined multi-band catalog has been used to 
measure pre cise photometric redshifts, galaxy sizes ( .Toft] 
et al. 2009) and to model the spectral energy distribu- 
tions to derive stellar masses, ages and star-formation 
rates (|Damen et al. 2009). We have made three cuts to 
the FIREWORKS sample to ensure that we are making 
appropriate field-to-cluster comparisons. First, since we 
are comparing galaxy sizes (densities) we require that 
the galaxies are bright enough to have a reliable size 
measurement in these ground-based data. Based on the 
comparison of size measurements from VLT/ISAAC and 
HST/NICMOS for the same galaxies. Toft et al. (2009) 
found that at K ~ 21.5 — 22.0 the scatter between 
these two size determinations increases significantly. We 
therefore select only K < 21.5 galaxies from FIRE- 
WORKS. Next, we have made a photometric redshift cut 
1.9 < z < 2.6 to select galaxies within the field at roughly 
the same epoch as the protocluster galaxies. Finally, we 
select the quiescent field population on the basis of the 
specific star- formation rate (log(sSFR) < — 11 yr~^). We 
note that after these cuts, the stellar mass distribution 
remains similar to our protocluster galaxy sample. 

For further comparison to our protocluster field data, 
we have compiled a sample of z ^ 2 quiescent galaxies 
published in the literature. We us e d four references for 
this sample: iCassata et al.^ (2010), van Dok kum e t al. 
(2008), Mancini et al. (201(3 ) and paracco, Lo nghett i, 
Andreon (2009). Saracco, Longhett i, ^ AncTreoni (|2(J09|) 
used HST/NiCMO'S Camera 3 as we have, Mancini 
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Figure 1. Outline of the NICMOS mosaic. The red and blue points mark the locations of the quiescent and star-forming cluster ^alaxiesl 
respectively. I'he yellow star is the radio ga laxy Mk(Jll38-262.' 



et al.| ( |2010[ ) used HST/ ACS imaging, |wi Dokkum etal] 
IpODSptTIdied HST/ mCMOS Camera 2 imaging while 
Cassata et al. ( 2010[ ) use imaging from the WFC3/IR 
channel on HI^T. 

We have attempted to translate these published stel- 
lar mass estimates to the same IMF (Salpeter) and to 
the same stellar population synthesis model set (Maras- 
ton 2005). We have used the analyses of Salimbeni et 
al. (2009; see their Fig. 1) to derive mean corrections 
between model sets. The adopted IMF also affects the 
derived star-formation rates. The offsets in this quan- 
tity are similar in magnit ude to the systematic shift in 
deriv ed stellar mass (e.g., Erb et aL||2006 Nordon et al. 
'2Q1Q[ ), so the specific star formation rate (i.e., the ratio ot 
star-formation rate to stellar mass) should be effectively 
unchanged. 

3. ANALYSIS 

Here we combine the multiband photometric catalog 
and the NICMOS high spatial-resolution imaging to de- 
rive physical parameters for individual galaxies. We pare 
down the total NICMOS galaxy sample to those which 
have a hig h quality- of- fit for the photometric redshif t (us- 
ing EAZY, |Brammer, van Dokkum, fc Coppi |(| 20Q8[)), the 
spectr al energy distribution (using J^AS'i', Kriek et al. 



( 2009)) and 2D s urface-brightness profile fit (using GAL- 
FIT, Peng et al.| ('2002a)). This reduces the galaxy sam- 
ple from the iiieo-band detected total of 711. 



We further 

restrict our attention to those galaxies which m ost l ikely 
lie within the known protocluster (see Section ^3.4). 



3.1. Photometric Redshifts 



Th e thirteen filter photometric catalog (Tanaka et al. 
2010) was used to determine galaxy photometric red- 
shifts. We used the public code, EAZY, to fit a set 
of model t emplates to each galaxy's photometric data 
( Brammer, van Dokkum, fc Coppi^^2008J . We required 



that each galaxy have at least 5 colors measured for the 
photometric redshift fit. The set of SED templates we 
used included both galaxy spectral energy distributions 
and a narrow emission line spectrum. EAZY uses all lin- 
ear combinations of the input templates to find the best 
photometric redshift fit. For each fit, EAZY produces 
the full redshift probability distribution (see Figs. |2]- 4|. 
We are most interested in the galaxies detected m the 
relatively smah (-- 50'), but deep, NICMOS i^ieo-band 
area. Therefore, we have only included sources detected 
in the i^ieo NICMOS images. For the target redshift 
of z = 2.2, the primary strong spectral feature covered 
by the photometric data is the 4000A break. We note 
that even with 13 bands of imaging, photo-zs are not 
sufficiently precise to determine whether a galaxy is in- 
side the cluster or not. There are 12 spectroscopically 
confirmed (emission line) protocluster members within 
the NICMOS mosaic. Of these, four Ha and one Lya 
emitters have well-determined photometric redshifts (the 
remaining members are generally too faint to have de- 
tections in enough bands). Four of the five photo-zs are 
around z ~ 2.1, ranging from 1.8 to 2.1. There is one 
clear outlier, the Ha emitter with 2;phot = 0.33. 

3.2. Stellar Population Modeling 

Using the calculated best-fit photometric redshifts, we 
used FAST ( |Kriek et aL]|2009D to fit stehar population 
model templates to the rest-trame photometry. These 
templates consist of a grid of models drawn from the 
Maraston (2005) set. We chose to use the Salpeter IMF, 
exponentially declining star-formation histories with r 
varying between 10^ and 10^^ years and Ay between 
and 3 magnitudes. FAST calculates the best-fitting 
model template among the grid and thereby derives a 
luminosity- weighted mean stellar age, stellar mass, star- 
formation rate and extinction for each galaxy. FAST also 
outputs the la error estimates for each of these fit pa- 
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Figure 2. Upper panels, left to right: Galaxy image, GALFIT best-fit model and image residuals after subtraction of the model. Lower 
panel: Photometry and best-fit SED model from FAST (red circles and solid black line Kriek et al. 2009). The shaded regions represent 
the photometric redshift probability distribution (upper scale) centered at rest-frame 4000A. 



rameters. We show the derived masses and their errors 
for the protocluster galaxies in Table [T] We note that 
the star-formation rates from SED fitting are equivalent 
to a dust-corrected rest-frame UV SFR and that none of 
our quiescent protocluster galaxies have significant de- 
tections in the MIPS 24 /im image (20693, PI: Stanford). 
Since we are only concerned with differentiating the qui- 
escent and star- forming galaxies, our results are sensitive 
only to catastrophic errors in these SFR determinations. 

3.3. NICMOS Galaxy Sizes and Morphologies 

NICMOS camera 3 provides good angular resolution 
over its field-of-view (PSF FWHM ^ {)'!21). To e xploit 
this resolution we have used the GALFIT code (iPeng 



|et al. 2002a) to fit analytic Sersic surface-brightness pro- 
nles (Sersic 1968) to all the i^ieo < 26.5 sources in our 
i^i6o-band mosaic. We have used our own error map as 
input to GALFIT for properly weighting the image pix- 
els and have masked all neighboring objects. A model 
point-spread function was created for each of these galax- 
i es ind ividually by generating a TinyTim simulated PSF 
( Krist|p^9 3) at the galaxies' positions in each exposure 
and then drizzling these PSFs together in exactly the 
same fashion as for the data themselves (see Zirm et al. 
2007). We then executed several different runs of GAL- 
FIT. We ran fits holding the Sersic index constant at 
n = 1 and 4, using a single model PSF for all galaxies. 



using a stellar PSF instead of the model(s) and holding 
the sky value fixed at zero. For all fits we restricted the 
Sersic index, n, to be between 0.5 and 5. The range of 
output fit values for all these different runs gives us an 
idea of the variance of the derived parameters due to 
model assumptions. We choose the best fit from these 
runs by applying the F-test to the resultant values. 

The primary source of systematic offsets in galaxy pro- 
file and size fitting is the estimation of the local sky value. 
If the sky is underestimated the galaxy size can be overes- 
timated, particularly for small faint galaxies. Therefore, 
we compare our fits where the sky level is a free param- 
eter with those where we explicitly fix the sky to zero. 
Many of the "zero-sky" fits fail to converge, for those that 
do converge and have comparable chi-squared values to 
the corresponding free fits, we can compare the output 
Tg determinations. It does not appear to be the case that 
equally good fits are obtained with and without fitting 
the sky. In those five cases where an F-test shows the 
zero-sky fit to be better, the sizes agree within the errors. 
Furthermore, none of these where the zero-sky result is 
comparably good are for any or our protocluster galax- 
ies. We note that the GALFIT sky values while non- 
zero are consistently several orders-of-magnitude smaller 
than the values corresponding to galaxy pixels. This sen- 
sitivity of the fit parameters to even slight variations in 
the sky highlights the importance of fitting the local sky 
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Figure 3. Fig. 1 cont. 
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along with the galaxy parameters (even in sky-subtracted 
data). 

We also note that additional scatter to the derived rg 
values introduced by using a stellar rather than model 
PSF is about 10 — 20% and therefore comparable to the 
scatter on the single-fit measurements themselves. 

3.4. Sample Selections 

We use the surface-brightness profile and stellar popu- 
lation fits along with the photometric redshifts to define 
three sub-samples of the NICMOS-detected galaxies. We 
detail these in order of increasing restriction. The initial 
sample is defined by a single i^ieo-band limit of 26.5 (AB) 
and consists of 711 galaxies. 

3.4.1. GALFIT Sample 

We ran GALFIT on the full i^ieo-hmited galaxy sam- 
ple. Using the distribution of GALFIT xl values for the 
fits we identify galaxies with good quality-of-fit {xt < 2; 
577 of the input 711). We then calculate the circular- 
ized Te (= y/ab) for these well-fit galaxies. We use this 
GALFIT sample in our analysis of the dependence of the 
Sersic index, n, on radial position within the cluster (see 
left panel of Fig.[7|). We note that we have re- normalized 
the input sigma (error) maps such that the best fits have 



Xl 



1. 



3.4.2. Stellar Populations Sample 



To select galaxies with good constraints on both the 
stellar mass and star-formation rate we have selected an- 
other sub-sample for the initial 711 galaxies. For targets 
with both good photo-z fits and narrow redshift proba- 
bility distributions (ODDS > 0.90, meaning 90% of the 
probability distribution is contained within the Az = 0.2 
around the peak value) the sample comprises 190 galax- 
ies out of the 711. The photometry for these targets were 
fit using FAST. From this set we have identified 112 with 
reliably derived parameters (v? < 3.0) based on the SED 
fits (for example, see Figs. [2||4|. 

3.4.3. Probable Protocluster Galaxies 

Finally, we have identified a sample of candidate pro- 
tocluster members using photometric redshifts. In lieu 
of spectroscopic redshifts, which are difficult to obtain 
for z ~ 2 red, quiescent galaxies, this selection should 
reject most of the interlopers. We consider only galax- 
ies with a robust photometric redshift (as above) that 
have probability P{z) > 20% at the protocluster red- 
shift {z = 2.156). We further require that these galaxies 
also are members of the "Stellar Populations" sample. 
These selections result in a sample of 11 galaxies, nine of 
which are quiescent (logio sSFR < — 11 yr~^). We show 
the galaxy cutouts, the best-fit Sersic model, the model 
subtraction residuals, the broad-band SED fit and photo- 
metric redshift probability distribution for these galaxies 
in Figures [2][4| 
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Figure 4. Fig. 1 cont. 



3.5. Stellar Mass Density 

The surface (volume) mass density in individual galax- 
ies is a fundamental property which seems to correlate 
directly with the absence of star form ation (e.g., Kauff- 



mann et al. 2003 



2008) 



To measure this 
mass estimates based 



Franx et al 
quantity requires accurate total 
on either stellar velocity dispersion or, much more com- 
monly, the stellar mass from SED fits to the broad-band 
photometry. Along with the resolved surface-brightness 
profile to determine the galaxy size we can calculate the 
mass density. We must make the assumption that light 
traces mass and that there are no strong gradients in the 
stellar mass-to-light ratio, i.e., we measure M/L for the 
integrated galaxy light and assume that value applies to 
the resolved profile in a single broad-band image. 

For our galaxies, we calculate the average surface mass 
density (Sso in Mq kpc~^) within the (circularized) ef- 
fective radius (rg) as follows: 



^50 



M,/2 



(1) 



We present our measurements in Table [T] 



4. RESULTS 

4.1. Distribution of Internal Surface Mass Densities 

We have used the combination of photometric red- 
shifts, stellar population modeling and surface-brightness 



profile fits to calculate internal surface mass densities 
for our protocluster sample. We have also added data 
from the literature and from FIREWORKS to construct 
a well-populated density versus stellar mass diagram in 
Figure [5] If the published data had a measured star- 
formation rate in addition to the stellar mass we have 
restricted the points plotted to those with low sSFRs 
(quiescent; logio sSFR < — 11 yr~^). In cases where the 
star-formation rate was not quoted explicitly, we only 
plot those galaxies which are described as "quiescent" 
by the authors. This distribution for both our protoclus- 
ter candidates (yellow circles and squares for quiescent 
and star-forming) and the field sources from the litera- 
ture (black squares) and FIREWORKS (blue squares) is 
shown in Figure [5j For the comparison field sample we 
have restricted to FIREWORKS galaxies brighter than 
K = 21.5 and with photo-z between 1.9 and 2.6. We 
have made the same redshift cut for the literature sam- 
ple. This redshift range approximately corresponds to a 
1 Gyr epoch centered on the protocluster redshift. 

The mean density of the protocluster sample (log 
< Sso >= 9.9) is 0.5 dex lower than that for the field 
sample. For the stellar mass range of our protocluster 
sample, lO^^-^M© < < where the mass 

distributions are similar, we can calculate the distribu- 
tion of the surface mass densities irrespective of total 
stellar mass. We have also used the KS test to calcu- 
late the probability that the (quiescent) protocluster and 
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Figure 5. Surface stellar mass density (E) vs. total stellar mass for individ ual ga laxies. The blue an d black squares are from the 
FIREWORKS s urvev fToft et al."'2009") and other literature ( |van Dokkum et al |2008 | jCa ssata et al."2010" "Mancini e t al.||2010| |Saracco,| 
[Longhetti, A ndreon 2ULI9) respectively. The large blue squares are the K > 21.5 i^lKEWUKKy galaxies included in tJie Kb test, ihe 
yellow circles with error bars are the 8 likely quiescent protocluster members. The two yellow squares are the star-forming protocluster 
galaxies (the third falls at 5 x lO^M©). The shaded regions are the local relations for early- type (light red) and late- type galaxies (light 
blue). Note that most of the protocluster members have lower densities than their field counterparts. 

field densities are drawn from the same parent distribu- 
tion. A fiducial value of Pks < 5% may be considered 
sufficient to reject the null hypothesis that they are from 
the same parent. In this case Pks '^5% and is there- 
fore a relatively strong constraint. We have perturbed 
our measured densities and re-calculated Pks for 10000 
trials. We show the distribution of Pks in Figure [6l For 
the black (yellow) histogram 30% (60%) of the realiza- 
tions fall below Pks = 5%. Both histograms have tails 
to higher probabilities. 



4.2. Radial Dependencies 

In order to assess possible radial gradients in the galaxy 
properties within the cluster, with respect to the radio 
galaxy, we have constructed the histograms shown in Fig- 
ure [71 For each of these four physical galaxy parameters: 
Sersic n value, surface mass density (S), stellar mass 
(M^) and specific SFR, we have made a single cut in 
the galaxy sample and plotted two radial histograms for 
above (orange) and below (blue) the chosen cut value. 
The left panel of Fig. [7| shows the histograms for the full 
galaxy sample appropriate to each parameter, i.e., the 
GALFIT sample for the Sersic n value. For the rest, 
the galaxies must also be in the stellar population sam- 
ple. The right panel shows the histograms for our proto- 
cluster galaxy sample (both quiescent and star- forming) . 
We have presented these two analyses because while the 
presence of field galaxies in the larger samples will dilute 
any result, the statistics are poor for the quiescent pro- 
tocluster galaxy sample. Furthermore, this field exhibits 
a factor of six surface overdensity of red galaxies (Zirm, 



1000 



500 




0.5 0.0 



Figure 6. The KS probability distributions for the protocluster 
versus field galaxy comparison. The black histogram are derived 
from 10000 runs with the protocluster densities perturbed at ran- 
dom within the Gaussian errors. The yellow histogram is the same 
but excluding the most dense protocluster galaxy. The vertical 
dashed line marks Pks = 0.05. About 55% of the realizations fall 
below the 5% probability. 



et al.||2008p , so the large sample may not strongly dilute 
trends. 

For each pair of histograms we have run the two-sample 
KS test to determine whether the distributions are con- 
sistent with one another. However, for the full sample 
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(left) the Sersic n distributions are more dissimilar than 
for the other parameters with a low Pks = 5%. This 
low probability seems to be the result of a relatively flat 
distribution of the n < 2.5 galaxies with radius contrast- 
ing with the structure in the radial distribution of the 
higher n galaxies. This hint may imply a scenario in 
which the galaxies are deeper within the gravitational 
potential. We discuss this point further below. In the 
future, with spectroscopic redshifts for red galaxies, it 
will be possible to repeat this test with better interloper 
rejection to see if the discrepancy between histograms is 
significant for bona fide protocluster galaxies. 

5. DISCUSSION 

We have presented the combined analysis of 13 band 
photometry and high spatial-resolution NIR imaging in 
the field of a known galaxy protocluster at z = 2.16. In 
cases like this where there is a known, confirmed overden- 
sity and strong statistical evidence for a dominant contri- 
bution from protocluster members we can make progress 
despite the lack of spectrocopic redshifts. We have iden- 
tified a robust sample of likely protocluster galaxies. Our 
conclusions are tentative and tempered by the following 
caveats. We do not have spectroscopic redshifts for the 
quiescent cluster galaxies. While we have done our best 
to isolate the most probable cluster members, they may 
still be field galaxies. The cluster sample is also relatively 
small and the results are therefore more suggestive rather 
than statistically robust. Finally, due to the limited areal 
coverage of the protocluster (see Fig.[T]), the very massive 
galaxies may be underrepresented in the cluster sample. 
These may also be more dense. 

Possible stellar population model offsets have been 
minimized by converting the literature points to the same 
models and IMF we used to fit the cluster galaxies. 

5.1. Evolution of Galaxy Structure and Stellar Mass 
Surface Density 

From the initial discovery of SEEDs, in general field 
surveys, the primary question has been what evolution- 
ary processes affect the SEEDs between z ^ 2 — 3 and 
z = that bring them in line with the local mass-size re- 
lation. If the dominant process is galaxy merging, then 
we might expect that most of the full galaxy mergers, as 
opposed to tidal interactions and harassment, may have 
already happened. While if the primary determinant of 
galaxy density is the formation redshift, the young Uni- 
verse being denser, we might expect that cluster galaxies 
will be denser than their field counterparts having formed 
earlier. 

In our data we see some indication for a difference 
between the profile shapes and density distributions for 
protocluster versus field galaxies (Fig. [5|. For our sam- 
ple of likely quiescent protocluster galaxies their stellar 
densities are lower and perhaps even the Sersic index is 
higher than for similarly selected field galaxies. From 
other studies it appears that the majority of fiel d SEEDs 
have higher ax ial ratios (fiattened) with n ~ 2 (van der 
Wei et al.|[2QnD . 



older stars than their field counterparts at the sam e red- 
shift (e.g.,|Steidel et al.| |2QQ5| [Tanaka et al.||2QlQ| ). This 



advanced evolution in t. 



5.2. Cosmic Merger Clocks 

Several previous studies have shown evidence that pro- 
tocluster galaxies tend to be more massive and contain 



]he cluster environment may also 
extend to the internal structure and dynamics of the 
galaxies. At lower redshift, we observe a morphology- 
density relation, and we may be seeing the beginnings 
of that relation in the MRC 1138 protocluster. Further- 
more, the lower densities of the protocluster galaxies sug- 
gests that the necessary merging has also taken place at a 
quicker pace than in the field. If we assume then that all 
galaxies begin as dense SEEDs at high redshift, we can 
use the observed densities as a measure of the "merger 
age" of the remnants. A similar idea was put forth by 
Hopkins and Hernquist (2010) to derive the global star- 
formation history by using the mass profiles of galaxies. 
They propose that the dense cores of galaxies form early 
in starbursts and the outer parts form in a more quies- 
cent mode, perhaps in disks. Based on the results from 
this paper we suggest that the resolved mass profiles can 
be used further to constrain the redshift of formation and 
the subsequent merger history. The ratio of high-density 
stellar mass to low-density stellar mass may tell us some- 
thing about the merger age of a galaxy while the absolute 
density of the highest density stellar components may tell 
us about the formation redshift. Studies at low-redshift 
have already found some correlation between galaxy den- 
sity and the mean stellar age (e.g., |van der Wei et al.] 
[2009|. With more precise stellar ages lor z 2 galaxies 
now becoming available we can extend this analysis to 
high-redshift when the fractional age differences between 
galaxies are larger. 
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Table 1 

Protocluster Candidates 



Object Photometric Odds ^^leo Line Stellar Specific Effective Effective Mass 

Object Redshift (AB) Mass SFR Radius Radius Density 

(log(M0)) (log(yr-i)) (^0 (kpc) (10^ Mokpc-^) 



Quiescent Protocluster Galaxies 
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± 
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Line-emitting Candidates^ 
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^ Narrow-band selected objects that are not yet spectroscopically confirmed. 
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Figure 7. Radial (measured from the radio galaxy) distributions of galaxies as a function of four derived physical parameters. Top to 
bottom: Sersic n value, surface mass density (E), stellar mass (M^) and specific star-formation rate. For each parameter we have made 
a single cut of the total sample into two bins and plotted those two histograms separately for those above (orange) and below (blue) this 
cut. The value of the cut is shown below the parameter name and the number of galaxies in each bin to the left of the name. Finally, the 
KS probability, that the two histograms are drawn from the same parent distribution is also shown. 



